Does Adiabatic Quantum Optimization Fail for NP-complete Problems? 
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It has been recently argued that adiabatic quantum optimization would fail in solving NP-complete 
problems because of the occurrence of exponentially small gaps due to crossing of local minima of 
the final Hamiltonian with its global minimum near the end of the adiabatic evolution. Using per- 
turbation expansion, we analytically show that for the NP-hard problem of maximum independent 
set there always exist adiabatic paths along which no such crossings occur. Therefore, in order to 
prove that adiabatic quantum optimization fails for any NP-complete problem, one must prove that 
it is impossible to find any such path in polynomial time. 
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Adiabatic quantum optimization (AQO) was originally 
proposed [l| as a possible means for solving NP-complete 
problems faster than classical computation. In AQO, the 
Hamiltonian of the system is evolved from an initial form, 
Hb, whose ground state defines the initial state of the 
system, to a final Hamiltonian Hp, whose ground state 
is the optimal solution to an optimization problem. To 
ensure a large amplitude of the ground state at the end 
of the evolution, the computation time t f should increase 
as t f ~ <?~ ln , where g m [ n is the minimum energy gap be- 
tween the ground and first excited states during the evo- 
lution. The complexity of AQO is therefore determined 
by the scaling of g m in with the problem size. 

Since its proposal, the complexity of AQO for solving 
NP-complete problems has been a subject of controversy. 
Early works suggested possibility of polynomial scaling 
with the size of the problem [lj, but soon counterexam- 
ples were found @, HJ . Later it was shown that the size of 
the gap in those counterexamples can be increased signif- 
icantly by changing the adiabatic path Q or the initial 
Hamiltonian [f|. However, until recently, little insight 
existed on the physical process that can lead to exponen- 
tially small gaps. 

Using perturbation expansion, it was shown that a lo- 
cal minimum of Hp crossing with the global minimum 
near the end of the evolution, sometimes called a first 
order quantum phase transition, can result in an ex- 
tremely small g m im exponential in the Hamming distance 
between the two minima [6j. Using the same perturba- 
tion argument, Altshuler et al. [7] showed that for ran- 
dom exact cover instances, the probability of having such 
crossings increases with the system size and the crossing 
point moves toward the end of the evolution leading to 
an exponentially small gap. They, therefore, concluded 
that AQO would fail in solving random exact cover prob- 
lems and possibly all NP-complete problems. Others also 
came to similar conclusions in different ways Later, 
Knysh et al. [l(| questioned the result of [a] based on ne- 
glecting degeneracies of the minima and correlations be- 
tween them. Moreover, the possibility of avoiding small 
gaps by changing adiabatic path was again pointed out 
by Farhi et al. [Uj , and the fact that one problem can be 
mapped into many different Hamiltonians with different 



gap behavior was mentioned by Choi |12j . Those argu- 
ments, however, were based on numerical calculations for 
small problems, therefore inconclusive for large scales. 

In this letter, we study the NP-hard 17] maximum in- 
dependent set (MIS) problem, into which the exact cover 
problem can be mapped in polynomial steps 12|. Using 
perturbation expansion, we analytically show that: (i) 
For problems with non-degenerate local minima, or de- 
generate local minima distant from each other by more 
than 2 bit flips, it is trivial to choose an Hp so that 
no crossing occurs between any local minimum (minima) 
and the global minimum, (ii) If Hp has degenerate local 
minima, some exactly 2 bit flips apart, it is still always 
possible (although not as trivial) to avoid such crossings 
by changing Hb- Since there are infinite possibilities of 
choosing the total Hamiltonian, a valid proof of AQO fail- 
ure must show that it is impossible to find an adiabatic 
path with no level crossing in polynomial time. More- 
over, remaining in the ground state is not a necessary 
condition for solving NP-complete problems. As shown 
in Ref. [Uj], approximate solutions can also be used to 
solve NP-complete problems exactly in polynomial time. 
A proof of failure, therefore, must also show that no such 
approximate solutions can be obtained by AQO. 

The MIS problem is that of finding a largest set M of 
nodes in a given graph G, such that there are no edges 
of G between any nodes in M. If n is the total number 
of nodes in G, the problem of finding an MIS, M, can 
be expressed as minimizing a cost function (energy) on 
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with c > 1. The last term in ([T]) is zero for every inde- 
pendent set of nodes, because there is no edge between 
those nodes for which Xi = 1. Every dependent set, on 
the other hand, gets a positive contribution from the sum 
for every pair of adjacent nodes within it, thus resulting 
in a larger cost or energy. Therefore, without the linear 
term, ([1]) would have a hugely degenerate global mini- 
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mum consisting of all independent sets. Notice that such 
a cost function (without the linear term) has no local 
minima, because from every state it is always possible 
to remove nodes (i.e., switch Xi from 1 to 0) one by one 
to make all nonzero bilinear terms vanish. Therefore, it 
is always possible to get from any state to the ground 
state without ever increasing the energy. The role of the 
linear term in ([TJ is to assign different costs (energies) 
to different independent sets based on their sizes so that 
the global minimum (or minima) of (fT]) becomes an MIS. 
There can also be many local minima, which are maximal 
independent sets of the graph, i.e., independent sets that 
cannot be made larger by adding nodes. 

Our goal is to solve the MIS problem using AQO. We 
first represent every node with a qubit by substituting 
Xi— ^(of+l), where of is a Pauli matrix. Equation ((T|), 
therefore, turns into a 2-local Hamiltonian 



Hp = 
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with hi — rijc/4 — 1/2, where rii is the number of edges 
connected to node i (degree of £), and Jij = c/4 (= 0) 
whenever there is an (no) edge between % and j. We 
introduce time evolution Hamiltonian 



H = Hp 



XH f 



H f 



E A *<> 
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where A changes from oo to 0. 

Near the end of the evolution, where Acl, we can 
use perturbation expansion in A, taking Hp as the un- 
perturbed Hamiltonian, to calculate eigenstates of H. 
Let S be any maximal independent set (which could 
also be an MIS) of size s and \S^) be its correspond- 
ing state representing a local (or global) minimum of 



(|5J). From (JTJ we immediately find E s 



(0). 



Upon 



perturbation, the energy eigenvalue becomes Es(X) = 
E^ + XEP + \ 2 E { g ] + .... The first order correction 

E ( s 1} = (S^\H B \S^) = 0, because the operators of in 
Hb flip one qubit and therefore, the overlap of the wave 
functions vanishes. The lowest order non-zero term is 
therefore second order, which as we shall see is the dom- 
inant one. 

Now suppose that \M^) is the global minimum and 
|M'(°)) is a local minimum of @, each representing a 
maximal independent set (M and M') of size m and 
m' (< m) respectively. Let SE(X) = E M '(X)—E M (X) = 
SE(°'+\ 2 5E( 2 ' i +0(A 4 ) denote the energy separation be- 
tween the two states. To zeroth order, SE^°'=m— m'>0, 
as expected since M is the MIS. If at some A within the 
convergence radius of the perturbation, SE(X) < for a 
finite order of perturbation (l8j , this means that at some 
point A = A* the two levels should cross. This can lead 
to an extremely small minimum gap at the (anti)crossing 
point, which is exponentially dependent on the Hamming 
distance between the two minima jg]. 



We first consider the simplest case with no degeneracy 
and a uniform transverse field, Aj = 1. The second order 
correction to the energy is (with S — M, M') 
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Since Hb involves all single bit flip operators af, the sum 
is nonzero only for states \k^} that are 1 bit flip away 
from \M^): 



E (2) = _y± 
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where Bi is the energy cost of flipping qubit i from state 
|jS'°)), and di is the number of edges between i and nodes 
in S. Notice that di > 2, since di = implies that node i 
is not connected to any nodes in S, i.e., S is not maximal, 
and di — 1 implies that there is a degenerate state 2 bit 
flips away. Up to second order in A, we find 



£ S (A) = -(1 + A 2 ),s-A 2 ]T 



its 



cdi 
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Since s is largest for the MIS, the first term in ^ is 
minimum for the global minimum as desired. The sum, 
however, depends on di and could be larger for a local 
minimum than the global minimum. As a result, at large 
enough A, it can cause the two energy levels to cross. 
However, since c can be chosen to be arbitrarily large, it 
is possible to reduce the effect of the sum and therefore 
eliminate the anticrossing by increasing c. Physically, 
increasing c will push low lying excited states (specifically 
dependent sets) adjacent to the global and local minima 
upward while keeping the minima energies fixed. This 
would reduce the relative mag nitude of E K g> in ©, as 
it inversely depends on the excited state energies. For 
example, by choosing c = n, we get 



6E(X) > (1+A 2 )(m— m') - A 2 



n—m' X 

> H — 

2n-l 2 



(7) 



because m—mf > 1, mf > 1, d[ > 2, and the number 
of nodes not in M' is n—m! . This is strictly positive, 
therefore no anticrossing occurs between those minima. 

The above argument holds beyond second order per- 
turbation. Assuming c= n and that a minimum S is suf- 
ficiently isolated from other minima so that up to q bit 
flips the energy of the state always increases, the qth. or- 
der perturbation correction to the energy is 
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O(l). (8) 

The radius of convergence deduced from JHJ) is A c =|, 
and the contribution from each successive term is mono- 
tone decreasing within A c , so the second order term re- 
mains dominant. Moreover, neglecting the 0(1) part 
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of ([8]) compared to the first 0(s) term, we find that 
up to the qth order perturbation, where validity of © 
stands, we can write E M '(X) = (rn' /m)E M (X), therefore 
SE(X) — [(rn' —to) /m]E M (X) > 0, which follows from 
77i > m! and -Em (A) < 0. This means that up to the gth 
order perturbation, the levels do not cross. 

The price to pay for eliminating the level crossings is to 
increase the coupling constant c linearly with the size of 
the problem. Alternatively, one can keep c constant, but 
divide the linear terms in (fTJ by tt, to achieve the same 
goa l, as was done in [l2| (although the local minima in 
[l2| are degenerate). This leads to smaller energy steps in 
the spectrum of Hp and therefore higher required preci- 
sion. In both cases, the scaling of the coupling constant 
or precision with n is polynomial (linear), whereas the 
gain in eliminating the crossings could be exponential. 

One may argue that by increasing c with n, or equiv- 
alently dividing the linear terms in (TT|) by n, we reach a 
regime in which the bilinear terms in ((TJ) become domi- 
nant and determine the dynamics of the system. Thus, 
although there is no level crossing for A-Cl considered 
above, there could be one for l<§;A<Cn. In this region, 
one can neglect the linear terms in (fTJ and repeat the 
above perturbative argument keeping only the bilinear 
terms. However, as mentioned earlier, the Hamiltonian 
without the linear terms has no local minima, but only 
a hugely degenerate global minimum consisting of all in- 
dependent sets. Such a Hamiltonian, therefore, cannot 
produce a crossing in the way discussed above. 

So far, we have only considered non-degenerate states, 
which is indeed the level of discussion in Refs. ElEH. We 
now take a step further and discuss cases with degenerate 
minima. We first have to generalize (j4j to include degen- 
eracies. Suppose there are K maximal (or maximum) 
independent sets Sk of size s, with fc = 1, ...,K. States 
\S^') and also every superposition of them are therefore 
degenerate eigenstates of Hp. Perturbation in A removes 
this degeneracy. Let |S , ^°')= J2k Ck\S^} represent the 
lowest energy superposition after the degeneracy is lifted. 
With the positive sign of A,-, Ck will all be positive real 
numbers with the constraint: J^k = 1- The first order 
correction is zero because all Sk are the same size (s) and 
therefore one cannot get from one minimum to another 
by a single bit flip (adding or removing a single node). 
The second order correction is 
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AiAjCkCk' 
Bk.i 
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where Bk,i is the cost of flipping qubit i from state IS^ ), 
and the prime sign on the sum means that the sum is over 
all the paths from \S k °^) to \Sy ) with two bit flips by 
first flipping qubit i and then qubit j. 

If there are no two minima \S^) and ) that are 
exactly 2 bit flips distant from each other, © becomes 



similar to the non-degenerate equation ((4]). In that case, 
the argument deduced from ((4]) holds, i.e., level crossings 
can be eliminated by increasing c linearly with n. The 
exceptions, therefore, are cases with minima 2 bit flips 
apart from each other. The worst cases would have only 
one global minimum but numerous local minima 2 bit 

(2) 

flips apart. The negative contribution to Ew, can then 
become large enough to bring down the total energy of 
the local minima below that of the global minimum at a 
A < A c . This is the case we shall consider now. 

To eliminate the above crossing, we need to make the 
energy difference 5E(X) = m—m'+X 2 SE^ strictly posi- 
tive. This is achieved if 



A 2 

SE w = y^i 



E 

(k,k'),(.i,j) 



Aj A jCkCk 
B 'k,i 



>0. (10) 



Here, Bi (B' k f ) is the cost of flipping qubit i in the global 
minimum M (local minimum Mi). A sufficient condition, 
which is independent of CV-, is 



A 2 

— max 



Bi 



k ^— ' Bi 

k',(i,j) k - 1 



(11) 



This can be proved using the fact that for every non- 
negative, symmetric matrix A operating on unit vectors 
v, we have: max„ v T Av < maxj, Akk 1 ■ For simplic- 
ity, here we focus on the large c regime (e.g., c=n) for 
which the states that violate edges can be neglected. All 
calculations can be generalized to the small c regime, but 
the equations become more complicated. Condition (fTTj) 
becomes ^({A^}) > 0, where 



^({Ai» 



A 



max > 
k ^ 



A 



(12) 



Since there is freedom in choosing values of Aj, one can 
choose them such that T({Ai}) > 0. A successful assign- 
ment makes the first term in (|T2l large and/or the second 
term small so that the result becomes positive. A trivial 
choice is A ie M — a and A,^ M = 1. Let pf. = \M D-^fel- 
Since M' k is a local minimum, we have pk < m — 2. Also, 
there are at most n — m' local minima all 2 bit flips away 
from M' k . Therefore, 

J- > a 2 m — max (a 2 pk + m 1 — Pk + a{n — m')) 



> 2a 2 — a(n — m!) — m! + 1, 



(13) 



which is positive if 



n — m! + \ (n — to') 2 + 8(m' — 1) n — m' . 
a > —1 ^ L „ __. (14) 

Such an assignment, however, is not very useful, since it 
assumes knowing the solution to the problem. Neverthe- 
less, it proves the existence of at least one assignment of 
Aj for which no crossing occurs. 
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We now consider another assignment which does not 
assume the solution. Let M'={J k M' k andp = |Mf|M'|. 
We assign Aj S M' = P and Aj^// = 1. The last term 
in (|12|) is multiplied by /3 2 and the first term becomes 
m—p + P 2 p. We find T > m — p + f3 2 p — (3 2 [m' + n — m']. 
In order for T > 0, it is sufficient to have 



/3 < y/(m- p)/(n - p). 



(15) 



Therefore, as long as m > p, that is as long as there is 
at least one node in the global minimum that is not in 
any of the local minima, there exists an assignment of 
Aj for which no crossing happens during the adiabatic 
evolution. As before, the scaling of j3 with the size of the 
system is only polynomial. 

This assignment does not require knowledge of the 
global minimum (solution), but only knowledge of the 
local minima, which can be obtained by running the evo- 
lution multiple times with Aj = 1. If there is a crossing 
between the global minimum and the state comprising 
the local minima, every time the system does not reach 
the global minimum, it falls into one of the local minima. 
Moreover, other degenerate local minima in the neigh- 
borhood of the one reached can be obtained in polyno- 
mial time using local search. The more information is 
obtained from such suboptimal evolutions, the more one 
can adjust A,; to avoid the crossing. 

The above assignment may not eliminate all such cross- 
ings if 7tl — p. However, there are an infinite number of 
ways to define the input parameters. For example, one 
can choose nonuniform A, within M' or nonuniform Jjy . 
Combining these and other ideas may also give a Hamil- 
tonian that satisfies (ITT]) . There are therefore infinitely 
many possibilities to define a Hamiltonian for solving an 
NP-hard problem instance, many of which may not have 
level crossings. An iterative numerical method that fol- 
lows from the above ideas has proven to be successful in 
eliminating crossings in extremely difficult instances with 
highly degenerate local minima, even where m = p [Hj]. 
Other methods have also been proposed for finding an 
optimal path fl6| . 

It is important to note that we are not trying to prove 
that all level crossings between a global minimum and 
local minima can be eliminated in polynomial time. Nei- 
ther are we claiming that if they are eliminated, the MIS 
problem can be solved in polynomial time. Even if all 
level crossings are eliminated, the scaling of the mini- 
mum gap in the rest of the spectrum is still unknown. 
What we are stating here is that there always exist paths 
along which no crossing occurs, at least up to second or- 
der perturbation. Since MIS is NP-hard, any NP problem 
can be polynomially mapped onto it. Therefore, a valid 
proof that any NP-complete problem cannot be solved 
using AQO because of level crossings must prove that for 
the problem mapped onto MIS, it is impossible to find 
an assignment of parameters for which there is no level 



crossing. Further, due to the NP-hardness of approxi- 
mating solutions to MIS 13j, even if there are multiple 
crossings, AQO may produce sufficient solutions to solve 
NP-complete problems. 

In conclusion, using perturbation expansion, we have 
shown that for the NP-hard problem of MIS, it is al- 
ways possible to write down a Hamiltonian for which dur- 
ing the adiabatic evolution no crossing occurs between a 
global minimum and any of the local minima. If there is 
no degeneracy in the local minima, or if there are degen- 
erate local minima but no pair of them is exactly 2 bit 
flips apart, such a Hamiltonian can be trivially obtained 
by increasing the coupling coefficient between the qubits 
linearly with the size of the problem. In cases with lo- 
cal minima exactly 2 bit flips away from each other, one 
can use the freedom of choosing the initial Hamiltonian 
to avoid level crossings. In the latter case, finding an 
assignment for tunneling amplitudes A, may or may not 
be nontrivial. However, we have shown that such an 
assignment always exists. In general, there are infinite 
ways of defining the Hamiltonian, including those where 
many approximate solutions suffice, therefore it seems in- 
feasible to prove that no successful Hamiltonian can be 
obtained in polynomial time. 
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